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ABSTRACT 

Progranmed instruction was first developed in the 1920's and 
has been used quite extensively since World War II. The increasing 
necessity for efficient and effective utilization of men, manpower 
and money requires the introduction, both in civilian industry and 
the Navy, of any tool which will accomplish this end. The use of 
programmed instruction by private enterprise is increasing and 
shows promise of helping to further achieve the profits by which 
success is measured. The Navy has made several effectiveness 
studies of programmed instruction. However, the recent develop= 
ments and available courses point out many areas in which the Navy 


can benefit from civilian accomplishments. 


Li 








TABLE OF CONTENTS 


Chapter Tite 


1. 


5. 


Background 

Statement of the Purpose 

Definition of Terms 

Summary of Selected Related Subjects 
The Present Dilemma 


The Development of Programmed 
Instruction 


A Possible Solution for the Training 
Director 


The Group Surveyed 
The Questionnaire 
Appraisal of the Returned Questionnaire 


Navy Experience With Programmed 
Instruction 


Conclusions 

Bibliography 
Appendix A 

Appendix 
Appendix 
Appendix 
Appendix 
Appendix 


Q Ww Ye A w 


Appendix 


aie bal 


Page 


10 
10 
14 


ei 


28 
32 
2), 
aN, 


64 
67 
19 
ie 
81 
84 
87 
90 
92 





7 Oe o 





CHAPTER I 
. PART I. BACKGROUND 

For most business corporations, the period immediate=- 
ly following World War II was exemplified by high consumer 
demands, a minimum amount of competition and excellent pro=- 
fits. Although the recession of 1949 eliminated some of 
the marginal producers, the high governmental expenditures 
of the Korean Crisis eased the competitive pressure. By 
the middle and late Fifties many firms had had to go through 
a serious selfe-appraisal of their management methods to de= 
termine the manner in which their competitive position and 
profit outlook could be best improved. 

One of the functions which has of late come in for in- 
creasing investigation is the training of personnel. The 
"impetus of the "management trainee" program coincided with 
the influx of G.I. students to the labor market from about 
1948 to 1955. In many cases the program existed in name 
only and therefore can be considered to have been only par=-:: 
tially successful. In reality it was just another name ap-= 
plied to the training of the white collar worker. Most 
training of blue collar employees was loosely defined as 
“on-the-job training" with no formal training program in-= 


volved. 











Programmed instruction is one of the refinements 
that has been expanded upon since World War II in tne ef- 
fort to increase the return for the training dollar and/or 
to increase the output received for the same dollar input. 
As may be expected, not all corporations have had the same 
results with programmed instruction and many feel the na- 
ture of their business or the increased costs of initially 
installing some type of programmed instruction would ex= 
ceed the benefits. 

A review of the information available on the subject 
of programmed instruction and aids seems to fall into one 
of two categories. Experts support the use of programmed 
aids and instruction in its many forms. Its virtues are 
extolled in opinions ranging from acceptance as another 
worthwhile aid in performing a training function to advo= 
cating the teaching machine as the ultimate in education- 
al instruction. 

The opposite side of the coin is represented by the 
many people who feel that the lack of personal contact far 
outshadows the benefits that may be obtained through use 
of programmed instruction. As a result most of their ani- 
mosity is focused upon the teaching machine because this 
method involves the least personal contact. Most of the 
information reflecting these views is to be found in pub- 
lications covering the educational field. Rightly or 
wrongly many advocates of programmed instruction contend 


this opposition is due to an improper understanding of the 
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teaching machine and its use and the fear of job security 
by the marginal teacher. 

The opinions favoring the use of programmed instruc= 
tion can be found in several types of journals and period= 
icals. Educators, psychologists and industrial training 
personnel have all written articles advocating its employ= 
mente The fact that the "pro" rather than the "con" arti- 
cles appear in special journals is understandable as their 
purpose is instructive rather than destructive. The "con" 
articles are usually to be found in popular periodicals or 
general opinion type periodicals. 

Several misconceptions exist in the people's minds as 
to what programmed instruction is, what it will or will not 
do, how it is being used today and what are future predic- 
tions. It is not true that programmed instruction depends » 
upon a mechanical device known as a teaching machine. Tea= 
Ching machines are one method of presenting information. 
Depending upon the source of the machine it can vary from 
a cardboard frame to a complex electronic device. In addi-= 
tion to the hardware used to present the training, there 
are linear textbooks and scrambled textbooks as methods of 
presentation. 

Many misinformed people, among them Educators and in= v 
dustrial trainers, understand the purpose of programmed in= 
struction and the teaching machine is to eliminate the hu-= 


man instructor. This belief is definitely incorrect as 








programmed instruction is intended to supplement training 
and free the instructor from some of the routine tasks. 
In this manner a better grade of instruction will result 
for more time may be devoted to complicated teaching dut= 
ies and special assistance where required. 

Another common misconception is that programmed ine 
struction is designed primarily for the trainee who has 
had a minimum of formal education. This statement is de= 
finitely false. One only has to consult Appendix G_ to 
see that the courses vary from graduate level courses of a 
complex and technical nature to fundamental mechanical 
Operations and basic information courses. The degree of 
formal education required for an industrial training course 
is generally related to the task and not the individual. 

Contrary to many beliefs, a corporation does not have 
to be large or Wealthy to use some form of programmed ine= 
struction. The amount of money invested is entirely de= 
pendent upon the form of training aid that is decided upon. 
Programmed textbooks are relatively inexpensive but some 
complex machines can cost in excess of $5,000 each. There= 
fore, the training director must carefully analyze his 
training situation in terms of: (1) objectives, (2) the 
types of people to be trained, (3) training dollars avail- 
able, (4) number of people to be trained and, (5) how far 
are they from a central point where a teaching program 


could be established. This analysis will determine the 


utilization that can be made of training aids and it may 
possibly reveal that programmed instruction is not the 
answer to the training problem. If it does survive this 
analysis, this examination will help in clarifying the 
real objectives and what it will take to achieve them. 

While the amount of investment in programmed instruce “ 
tion need not be large it is equally true that the employ= 
ment of this form of training will not reduce overall 
training costs. The claim that can be made, however, is 
that proper use of effective programs will improve the 
caliber and amount of training which can be offered. 

PART II. STATEMENT OF THE PURPOSE 

The purpose of this research paper is to draw cone= 
clusions as to the desirability of including programmed 
instruction in an industrial training program. These con= 
clusions will be drawn as a result of a review of informa= 
tion which has been published on programmed instruction 
and an evaluation of the use and acceptance of programmed 
aids within industry. The evaluation includes a survey of; 
(Ll) industrial companies, (2) public utilities, (3) bank- 
ing institutions, (4) merchandising concerns, (5) life ins= 
urance companies and, (6) selected transportation companies. 

PART III. DEFINITION OF TERMS 

For the purpose of this paper the following defini-= 

tions and restrictions will apply; 
PROGRAMMED INSTRUC TION=-= 


1. A self-contained seauence of instructional 
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items which can be presented to individual 
students under controlled conditions. It is 
designed specifically to teach material and 

is repeatedly tested and revised until it 

gives consistent and acceptable results. 

The sequence of instruction items is generally 
presented in a series of small steps thus, per= 
mitting the learner to advance one step at a 
time to more difficult and complex materials 


as he masters the preceding material.’ 


ee LINEAR FORMS == 


4n unbroken sequence of small steps following 
2 
a single track. 


bo FRAMES ee 


The unit of content of each sequential step 


in a program. 


4, PROGRAM =. 


Subject matter to be learned by self-instruc= 
tional method; broken into bits and arranged 

in sequence leading to maximum understanding 

of the course. 


loavia B. Story, "Programmed Instruction and Its 
Implication for the Training Section." Industrial Re= 
lations Training Section Bulletin of the Boeing Corp= 
oration. June 1963, p.6. 


2p. David Niebler, “Programmed Instruction Saves 
Time -- and Grows." Personnel Journal, Vol. 41, No. 1 
(May 1963) p. 240. 


A Thid. 





*pusiness Management, "A Businessman’s Guide to 
Teaching Machines, August 1962, p. 44. 





5. EXTRINSIC PROGRAMMING == 
A program Sequence in which the steps are 
unalterable and identical for each trainee, 
not allowing for individual differences. 

)2 


(Linear program. 
6. FEEDBACK == 

After each of his responses, the learner is 

provided with information about the correct= 


ness, quality or appropriateness of his re=- 
sponse. 


7s REINFORCEMENT 


The rewarding experience derived from immed= 
fate success in responding correctly to a 


frame! 


8. BRANCHING == 


A program that has items built into it for 
either advanced or slow trainees. Altere 
mate sequences give remedial practice and 
new explanations to misunderstood material. 
By this technique, faster trainees can skip 
certain material for additional or more ad-= 
vanced items on the same subject.® 


Ibid. 





Omeodore B. Dolmatch, Elizabeth Marting, and Robert 
Ee Finley, Revolution In Training Programmed Instruction 
In Industry, Management Report Number 72, (New Yorks Amer= 
ican Management Association, 1962), p. 13. 


‘uiebler, WOE.” Cit. 


ORs T wes Management, loc. cit. 


oNiebler, loce cit. 








9. SCRAMBLED BOOK == 


The branching system in book form.” 


10. TEACHING MACHINE == 
A mechanism that presents information to a 
student and controls his behavior in a pre= 
determined interacting relationship.~° In 
order to meet the criteria as developed by 
the U. S. Department of Health, Education 
and Welfare a teaching machine must accomp=] 
lish five of the seven functions listed below: 
(a) Used for individual instruction. 
(b) Contains and presents program content in 
(c) thats a means whereby the student may 

respond to the program. 


(d) Provides the student with immediate in-= 
formation of some kind concerning his 


response. 

(e) Presents the frames of the program in- 
dividually. 

(f) Presents the program in a pre-determined 
sequence. il 


(zg) It is cheatproof. 


ll. PROGRAMMED TEXTBOOK <== 


The teaching machine in book form.-< 


INiebler, LOC. Cit, 


lOrawrence M. Stolurow, Teaching By Machine, (Washington, 
ah U. S. Office of Education, HEW, Supt. of Documents, 
1961). 


11 ames D. Finn and Donald G. Perrin, Teaching Machines 
and Programmed Learning (Washington, D.C.3 Ue S. Office of 
Education, HEW, Supt. of Documents, 1962), p. 18. 


leysebler, loc. cit. 








The conclusions that will be drawn as a result of 
this study will apply only to the field of industrial 
training. There will be no attempt to evaluate programe= 
med instruction in the field of school education. In 
addition, industrial use of programmed instruction will 
be defined to include use within the Departmens of the 
Navy, Army, and Air Force for any phase of military and/ 


or civilian training. 








CHAR Tat 
SUMMARY OF SELECTED RELATED SUBJECTS 
PART I THE PRESENT DILEMMA 

The point which is stressed most in any literature 
on programmed instruction is that regardless of the forn 
it takes, the benefit to be gained from its use is de= 
pendent entirely upon the amount of effort and intelli- 
gence that were employed in developing the progran. 

Perhaps the greatest obstacle to expansion of the 
use of programmed instruction is the need for sufficient 
Well constructed and tested commercial programs. Induse 
try interest in programmed instruction is evidenced by 
the inquiries which Business Management received to a 
house article. In the August 1962 issue of Business 
Management a feature entitled -= "A Businessman's Guide 
to Teaching Machines" was run. Nearly 500 letters were 
received by the publication requesting further informa- 
tion on how to obtain specific training programs. 

The necessity for good programs was further substane= 
tiated in almost all of the questionnaires returned by 
corporations which are employing this method of training. 
In many cases this meant internal development. For ex= 


ample, the Equitable Life Assurance Society of the United 


tnoger W. Christian, "Guides to Programmed Learning”, 


Harvard Business Review, Volume 40, Number 6, November= 
December 1062. De 36° 
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States had to spend months in planning, writing, testing 
and evaluating a twelve chapter 2500-frame program on 
"Life Insurance Fundamentals”. It is true that some of 
the time initially spent in the planning function by 
Equitable was investigating the general field of program- 
med instruction and therefore would not have to be re= 
peated. Never the less, the planning step will require 
study of such things ass; 
1. Problem areas requiring programs. 
2. What programs are feasible (e.g. restriction 
because of the number of personnel to be 
trained). 


3. How would this program fit into the over-all 
training program. 


4, Select the source materials. 

5. Type of training vehicle or hardware. 

6. Programming technique to be employed. 

7. Educational background of the trainees. 

8. Educational objectives of the programe 

Many firms have developed fairly good cost estimates 
in both time and dollars for constructing their own pro= 
grams. This information has been arrived at as a result 
on non-availability of commercial programs or the quality 
of those that were on the market did not m2et the require= 


ments of the company. Du Pont’s experience is that it 


-Johw T. Childs, "How to Develop Your Own Program= 
med Instructional Materials", (a presentation before the 
American Management Association Special Conference on 
uo Instruction in New York City on August 27 = 29, 
1962. 


ed 





takes three man=days to produce the equivalent of one hour 
of classroom instruction. They also feel that if a course 
can be given to 100 people the cost is justified. Easte 
man Kodak's information indicates their programs take 

from 30 to 60 minutes a frame. An average program runs 
between 500 to 1500 frames requiring a minimum of 250 
hours to a maximum of 1500 hours. IBM’s records indicate 
that the ratio of development hours to programs hours is 
five to one. 

Expressed in terms of dollars, estimates vary from a 
low of $4.00 per frame to a high of $30.00. To the devel~ 
opment cost an amount has to be added for printing. ‘The 
result is a total dollar cost that seldom will be less 
than $15,000 for a good 30-hour programs” 

There are instances in which a training director will 
determine that it is not practical to have his program de= 
veloped internally because there are commercial programs 
which will be adequate. In Equitable'’s case the program 
was tailored to fit their particular company requirements 
but a firm training a large number of employees in elec= 
tricity, for example, would be able to select from sever- 
al competent commercial developed programs. 

Because the program is available on the market does 


not necessarily mean that it is good or will adequately 


PRoger W. Christian, "Programmed Learning; Where 
it works, where it won't, what it costs", Factory, 
March 1962. p. 109. 


re 
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perform the task for which it is intended. The planning 
step in this case is the thorough evaluation and actual 
pilot testing of commercially developed programs to 
insure the training needs will be fulfilled. 

A well-planned text properly presented in many re= 
spects, approaches the situation of having a private 
tutor. Especially is this true when the students are 
well motivated -=- are really anxious to learn. Certaine= 
ly this is the situation in a large company where candi- 
dates are carefully chosen for a new endeavor in the ore 
ganization, and they realize that a raise or promotion 
depends upon how quickly they learn the new task and 
become productive on . 


+ F. Cooley, "Automated Teaching”, Computers 


and Automation, July 1962. p. 10. 
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PART II THE DEVELOPMENT OF PROGR4MMED INSTRUCTION 

There are two schools of programming technique each 
based upon a different set of concepts of Learning.” As 
teaching are one type of instruction aid and the theory 
that is employed is the same as that used in either pro= 
grammed textbooks or scrambled textbooks, ° the discus= 
sion that follows will deal primarily with the teaching 
machine. 

The dominant school is headed by Dr. B. Frederic - 
Skinner, Professor of Psychology at Harvard University. 
The second school is led by Norman A. Crowder, a former 
Ue. S. Air Force Psychologist, who is employed by the 
Western Design Division of U. S. Industries, Santa 
Barbara, California. Westerm Design manufactures and 
sells teaching machines and machine programs. 

Skinner's method of programmed learning is the re= 
sult of his work with animals, e&Specially pigeons. By 
applying what he had learned to humans, Dr. Skinner de= 
veloped a highly organized "linear form" method of teach-=-, 


ing based upon the theory of "conditioning." 


George A. We. Boehm, "Can People Be Taught Like 
Pigeons?" Fortune, 623177, October 1962. 


Gor. ante po 5 
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The program is supposed to take the student by the 

»- hand, as it were, and lead him every step of the way 
through 2a course. According to Skinner, a good proe= 
eram makes it almost impossible for a student to 
make a mistake. The subject matter is atomized into 
tiny bits, presented to the student as a series of 
simple statements. Hach idea is reveated over and 
Over again, always in different words. Many of the 
statements include blanks to be filled in by the stue= 
dent with a word or two. The object is to have the 
student "participate actively in the program.” By 
filling in the blanks correctly, he “conditions” hime 
a absorbing the information being presented to 
him. 


The key to this method, that of constant repetition, 


is additionally aided by testing after each frame. If the 
student has a correct answer he is rewarded immediately 
and allowed to go to the next frame. If he errs, he is 
required to repeat the last tiny lesson. 

With the pigeons, the acts to be learned were taught 
one step at a time. Each time that the pigeon made a cor= 
rect response, it was rewarded with a kernel of corn. It 
is a basic tenet of behaviorism that behavior patterns, 
such as learning, are essentially the same for all intelle 
igent species. 

Working from this premise, Dr. Skinner develoned his 
first programs which he tried on undergraduate students 
at Radcliffe and Harvard University in 1957. As a sub= 
stitute for the kernel of corn given to the pigeons, a 
psychological reward of feedback was given. By repeating 
the key word or phrase and allowing for feedback to the 
pupil three important concepts of psychology were put in= 


to plays 
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1. Recall rather than recognition (recall is trig- 
sered by a minimum of cues and is considered to 
indicate a greater degree of retention than 
does recognition). 

2. Reinforcement. 

3. Feedback for the programmer. If a pupil is 
making too many errors at any point in a pro= 
gram, it is the program, not the student, that 
is held to blame. 

Generally the machines used for presenting Skinner 
type programs are refinements of the original machine 
developed by Dr. Sidney Le. Pressey, now Professor 
Emeritus at Ohio State University. In the mid-Twenties, 
when Dr. Pressey introduced his machine, his intention 
was that it would be used primarily in the field of school 
education. At that time teachers were a surplus commodity 
and there was no public pressure because of a teacher short= 
age or a Russian "Sputnik" to accept new methods of instruce= 
tion. Even though the principal of the first machine has 
been carried over, the hardware in which it is contained 
has been changed considerably and comes in varities costing 
from $30 to over $5,000. In 1962 there were 84 machines 
listed by the Department of Health, Education and Welfare 
which met their criteria for school classroom instruction.°® 
With the use of teaching machines or either type of text- 
book the three psychological concepts mentioned above are 
put into play. 


Skinner believes that any subject which can be ex= 


plained verbally can be taught effectively through pro=- 


SUnited States Department of Health, Education and 


= Teaching Machines & Programmed Learning. 1962. 
Dp. 18. 
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srams. This does not necessarily mean machines, although 
that is the method he prefers for presentation. He is of 
the opinion that such learned subjects as advanced math-= 
ematics are actually mechanical and are therefore subjects 
for programming and use within industry. 

The validity of this reasoning is evidenced by the 
fact that the following courses in mathematics were re= 
ported in returned oquestionnaires as being used by in= 
dustry: (1) General Mathematics, (2) Algebra, (3) Geo- 
netry, (4) Trigonometry, (5) Calculus, (6) Statistics, 

(7) Numbers, and (8) Boolean Algebra. 

As indicated earlier, the program writer must uncere-’ 
stand both the process of learning and the subject matter 
to be taught. If this is accomplished the programmer can 
teach students to think deeply and perhaps originally. 

The program puts the student in contact with the program= 
mer, who must be superior to the average teacher accorde= 
ing to Skinner. The programmer through his programmed 
teaching will be able to influence a great many more traine 
ees then training personnel can do under 4&4 conventional 
lecture type program. 

while more and more psychologists and educators are 
testing and expanding the use of programmed instruction 
as advocated by Dr. Skinner, Norman Crowder is urging 
that his type of programmed instruction be accepted. He 
has found very little support among psychologists for his 


philosophy, which is based upon a non-behaviorist concept 


Ly 





of learning and resembles conventional teaching much 
more than does Skinner's. Instead of conditioning stue= ° 
dents to learn, he provides them with programs designed 
to serve as a private tutor. The basic difference is 
that Crowder dispenses much more information at one time, 
often several meaningful paragraphs to a frame, rather 


than atomizing this information.” Major differences are: 


Crowder Skinner 
1. Dispenses large seg= Information given in 
ments of material small bits --repeated 
often 
2. Acts as a private tutor Conditions students 
to learn 
3. Branching permitted All steps in sequence 
-~no skipping 
4, Permits mistakes (tries Makes it virtually 
to anticipate them) impossible to go 
wrong 
5» May use a multiple Trainee must con= 
choice type question struct answer 


Although Crowder's theories have not had the accept= 
ancy that Dr. Skinner's have, the former has been success= 
ful in having programs published in book form by Doubleday. 
The books, called Tutor=-Texts, do not resemble convention= 
al textbooks in that the material on page two does not 
follow the material on page anger. It may be from the 


middle of the course or the end. By scrambling in this 


FBoehm op. cite, De 259 


10 scrambled textbooks, cf. ante. Pe 5. 
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manner it is supposed to reduce, if not eliminate, cheat= 
ing by the student. 

In 1960 Crowder was also successful in selling 18 of 
U. Se Industries’ $5,000 AutoTutor machines to the U. S. 
Air Force. These machines were used at Keesler Field, 
Mississippi to teach fundamentals of electronics to air= 
men using 2 Crowder developed program. 

Both psychologists are in agreement on two importe 
ant points. The first of these is that the trainee is 
allowed to proceed at his own pace. This possibility 
permits those who have difficulty with any of the matere= 
ial being presented to move as slowly as necessary. At 
the same time, the person who is able to comprehend the 
training rapidly can move right ahead. In neither case 
would the trainee invonvenience any other student. 

The second point on which Skinner and Crowder are in 
agreement is that the best vehicle for presenting pro= 
grammed instruction is the teaching machine. They feel 
that a machine which presents the material frame by frame 
reduces cheating by the trainee. In the case of program= 
med instruction cheating has a somewhat different cone 
notation than that we usually associate with the word. 
The object of programmed instruction is to teach not quiz 
a trainee. Therefore the lazy trainee who is working from 
a book or loose leaf papers is tempted simply to glance 
through or scan the material rather than seriously apply= 


ing himself to finding the correct solution to the problen. 


19 





~~ Ss — 
= 





Even though there is agreement expressed in the a= 
bove paragraph, programmed material need not be presented 
by machine to be effective. In fact, training directors 
returning the questionnaire seemed to favor some form of 
textbook presentation. Although no definite reasons have 
been given in most cases, it can be assumed that the inic- 
tlal cost of a machine installation is the factor that 


rules out machines. 


20 








PART III = A POSSIBLE SOLUTION FOR THE TRAINING DIR&CTOR 

A training department competes with all other de= 
partments for funds or is supported by the departments 
benefiting from the trainee's instruction. In either case 
management finds it difficult to approve the disburse= 
ment unless it can be proven that the number of trainees 
and the reoccurrence of the need Warrant the expenditure. 

Regardless of the preferred method of presenting 
programmed instruction, it is the answer to three indus- 
trial training problems. According to J. L. Hughes and 
W. J. McNamara of the International Business Machines 
Corporation, industry has always suffered from a shortage 
of qualified instructors. Generally speaking, this may 
be attributed to the fact that the industrial trainer is 
a highly skilled specialist, perhaps even a psychologist, 
but he lacks formal training in the field of education. 
His unintential mistakes in technical educational areas 
can destroy much of the value of his training course. 
Another associated matter faced by the industrial instruce 
tor is inadequate time for lesson preparation as a result 
of the number of classes it is necessary to conduct to 
meet a training deadline. 

Secondly, the number of persons to be trained is so» 
small that required training must be deferred until en-= 
ough trainees are available to justify the cost. A ree 
lated problem faced by many training departments is the 


manner of conducting training for second and third shift 
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personnel. Regardless of the solution, the trainee is 
seldom satisfied by having to put in paid overtime to 
receive the instruction. 

The third problem is that of training employees 
from a plant who work in widely dispersed locations with= 
in a metropolitan area. Bringing the trainees to a cene= 
tral location involves considerable expense in transporte 
ation and time away from the job. For a detailed and 
lengthy course there is often no acceptable answer other 
than hiring additional personnel. 

These three problems can be significantly alleviated 
by programmed instruction. Because the new training 
package of educational material makes a self-sufficient 
package of educational material available to each traine 
ee, it reduces the need for qualified instructors in 
many courses and allows the company to train its employ= 
ees individually and at any time and place. Beyond this, 
programmed instruction offers the possibility of train-= 
ing employees more quickly and more effectively than 
traditional methods allow.++ 

There's a feeling in programmed instruction circles 
that any teacher who can be replaced by a machine should 


be. 


ai L. Hughes and W. J. McNamara, "The Potential of 


Programmed Instruction," Personnel, Nove-Dec.,1961,p.63-6 
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A number of industrial instructors, and even training 
dircovemen are certainly inadequate enough to qualify.?@ 
Any training director who has the foresight to insure 
that an efficient program is properly used need not fear 
for his job, for the effectual employment of these tools 
can only enhance his position with his superiors. 

Military training is somewhat different again. The 
expenditure by the Air Force in excess of $100,000 for 18 
AutoTutors and programs at Keesler Field is much easier 
to justify. As is the case in training of military air- 
men in fundamentals of electronics, most trainees are goq= 
ing through a training cycle with a large group. The 
machines can be effectively utilized during the day and 
the continuous input of personnel in such a program re= 
sults in a low per pupil cost for instruction equipment. 

Training personnel in industry have indicated that 
it is practical to develop programs for those jobs in 
Which you have "conformity learning”. Generally speaking 
this breaks down into these five general types; 

le Rote memorizing (procedures, names, fixed rules) 


2. Job skills (lubrication, filing system, credit 
policies) 


3e Problem solving (training assembly line inspec= 
tors, quality control) 


e 
Christian, "Guides to Programmed Learning,” op. cit., 
Pe 376 
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4, Mastering concepts or generalizations (algebra, 
slide rule technigues, PERT) 


5. Pattern recognition (assembly line jobs, 
sorting) 13 


To those training situations falling into the above 
categories several advantages accrue. It must be empha-= 
sized that it is not necessary to scrap a good program 
presently in force to gain these benefits. Most of the 
successful industrial training departments have supple= 
mented, not replaced, a competent program. In this man= 
ner they have been able to measure greater effectiveness, 
a consistency in instruction and dollar efficiency of 
training. For many of the larger corporations these 
accomplishments are combined with a degree of decentral= 
ization of training not previously possible. By bringing 
the training to the trainee when it is needed per diem 


(hit 


costs often associated with instruction are reduced if 


14 have 


not eliminated. A variety of indirect benefits 
been recognized but accurate measurement of many is not 
possible. 

The outstanding, and probably most successful, pro= 
gram described in the references is the assembly line 


operation which Hughes Aircraft Company has installed. 
L 
Christian, op. cit., po 110. 


ary oe improved supervision, higher morale, better 
defined training goals. 
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Hughes installed over 1,000 Videosonics in production 
lines in Tuscon, El Segundo and Fullerton. The pilot 
test was run in 1958 in the Tuscon plant on a Falcon 
Missile assembly project. The results of this test were 
a reduction of production defects ranging from six to 
thirteen per chasis at the start of the test to 0.06 per 
chasis within a ten month period, a reduction of 994. 

The Videosonic combines visual presentation with 
tape instruction. The hardware resembles a portable TV 
set. The visual presentation is on a 35mm. film strip 
and is synchronized with a magnetic tape recording. A 
set of headphones completes the unit and one set is ine 
stalled at each bench position on the assembly line. In 
this assembly process one operator completes an entire 
assembly rather than doing just one mechanical task. The 
speed of presentation is controlled by the operator and 
She is allowed to take as much time on each sequence as 
she feels necessary. 

The initial program, used when a new chasis or a new 
Operator comes on the assembly line, gives detailed pro= 
cedures and includes warnings of possible problem areas 
based upon production defects encountered in the paste 
When the operator is efficient enough to speed up the op= 
eration an abbreviated tape is used. This tape covers 


the operation but does not go into the detail as much as 


soe .g,cold solder joint, a solder splash, reversed 
components, insufficient clearance between components,etc. 
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did tape one. It does repeat the warnings that are ree= 
quired to keep the product up to standard as concerns 
quality control. The super=-short version, sometimes re= 
ferred to as the "Bikini", would just hit the major points 
as a brief outline would do for a book review. 

The drastic reduction of defects was only one of the 
benefits that Hughes obtained. Output was increased in 
all cases, as the realization rate between standards and 
production was increased from 60% to 90% and 100% on a 
consistent basis. Others factors of note were: (1) by 
reducing variables attributed to individual operators, 
production is much more standardized, (2) a special quale 
ify control group that acted as a check and test unit was 
eliminated entirely, (3) supervisors, who previously had 
been devoting almost all of their time to training, were 
now able to concentrate their efforts on managing person= 
nel, and (4) engineering changes could be introduced in a 
matter of hours rather than days as had been the case pree= 
viously 

Hughes also determined that the same type of program 
could be designed for operations such as machine shop and 
tube testing. The testing operation required the use of 
a cathode ray oscilloscope for comparing wave shapes with 
those of suspect tubes. Colored slides showing the exact 
wave pattern desired were used to make comparisons with 
the actual tube being tested. The effective testing time 


was reduced from just under five hours to 17 minutes. 
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On one assembly line making a critical inter-= 
mediate frequency amplifier, it previously required 
about four months for an operator to get up to the 
line's average realization of about 53% of the work 
standard. After Video-Sonics was installed, Hughes 
transferred a new operator from the wire harness 
line into the IF amplifier line. By the end of the 
first day she had achieved a rate of 80% of the work 
standard .t 


Hughes Aircraft has now entered the teaching machine 
production field because of their success with the Video-= 
sonic. The amazing results cited above could be the 
claim of an enterprising sales manager except that they 
were cited in several periodicals in 1960, prior to the 
time that the decision was made to enter the teaching 


machine production fiela.t! 


Te Jo Klass, "Video=-sonics Cuts Production 


Defects", Aviation Week, Vol. 72, Part I, January 4, 
1960. P o T7% 


lv Wass, Ope Ccit.,pp. 75-793 and Business Week, 
"How Machines Do Teaching Job," September 17, 1960. 
Dee Lil=-174. 
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CHAPTER III 
PART I. THE GROUP SURVEYED 

The large amount of information available on program= 
med instruction in use in industrial operations would lead 
one to believe that it has been widely accepted. In order 
to either prove or disprove this assumption it was neces= 
sary to conduct a survey of industry. 

In trying to determine who should be included in the 
Survery, further research was required to find the common 
ground upon which a decision to use programmed instruction 
could be based. The first idea that came to mind was the 
cost of the tools and hardware. When a review of prices 
revealed that teaching machines ranged from $25 to $5,000 
and textbooks were available from $3000 up it was evident 
that this could be, at best, only a partial answer. 

A second point was the size of the labor force but 
this did not seem to insure the use of programmed instruc= 
tion either. Meat packing and food processors employ 
large amounts of untrained labor but would not be good 
candidates for programmed instruction purchases. The 
automotive industry has tremendous labor rolls however, 
it was doubtful if they would be required to spend much 
money to bring workers to the level that he could fit 
pieces together, insert bolts in predrilled holes, spot 
weld, tighten nuts, etce 

The size of the company was another factor to be 


considered. This was tied in again with cost of the pro= 
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gram and there did not seem to be any definite coorelation. 
Nor did the type of business seem to be the key to employ= 
ment of programmed instruction. 

As long as there did not seem to be any one factor 
that could be applied, what combination of factors would 
satisfy the requirements? The following elements seemed 
to apply to some degree in most cases, although not all 
were applicable or to the same degree in any given ine- 
stance? 

l. Number of employees to be trained 

Co Repetitive nature of the training 

30 Size of the company - -..... 


4. Cost of the program == including aids and hard= 
ware 


5. Type of business 

6. Present size of the training function 

7. Management outlook, and 

8. Business success. 

There did not seem to be any way in which it would 
be possible to select, at random, a list of diverse corp= 
orations that would meet the requirements. 

Because of this the annual listing contained in the 
Fortune magazine of the largest corporations, from point 
of sales, seemed to fit most of the necessary elements. 
Even though it did not include small concerns, it seemed 
upon consideration that they probably would not qualify 
on many of the points. Their budgets would not permit 


the large initial expenditure and the number of employees 
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to be trained would be on an almost individual basis after 
completion of the elementary training. 

The Fortune listings of the largest companies based 
upon sales did not necessarily guarantee such things as 
profit, success, forward looking management or adequate 
training. It did insure inclusion of diverse industries, 
different size labor forces, companies that ranged from 
individual processing by skilled artisans to large assemb= 
ly line operations, both white collar and blue collar train- 
ing, and seasonal operations employing considerable itine 
erant and manual laborers. 


1 was sent to the Director for Train- 


The questionnaire 
ing of the following concerns doing business in the United 
states: 

lL. 500 largest industrial corporations 

ev 5 largest commercial banks 

3m 50 largest life insurance companies 

4, 50 largest utilities 

5. 50 largest retail merchandising firms, and 

6. 37 selected large companies. 

The answers received revealed that many of the large 
utilities were, in fact, holding companies. In many in= 
Stances the questionnaire was forwarded to the largest of 
the utilities within the company for an answer. 

The 37 selected concerns reported in item 6 above 


Were airlines, railroads, bus operators and over=the-road 


truckers also reported in the August 1963 issue of Fortune. 


1 oa¢ Appendix A. 
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Some large companies do not release figures in regard to 
their business and therefore, they could not be ranked by 
Fortune. JI included any large concern in this category 


that I knew from past experience was not on the List. 


eter Cargill, Inc. of Minneapolis, Minnesota. 
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PART II=THE QUESTIONNAIRE 

My primary purpose in sending out the questionnaire 
was to determine the extent to which programmed instruce] 
tion was being used and what forms of aid were employed. 
I did not attempt to determine the cost of programmed 
instruction for I felt that this factor might make many 
concerns hesitant about revealing any information. 

Fach firm was given the opportunity to reveal its 
corporate identity only if it so desired. Many companies 
did reveal their identity but asked not to be quoted by 
name in the study. 131 companies returned questionnaires 
Which did not list the company but their receipt contrib= 
uted immeasureably to the results of the survey. Most 
of the companies in this 1351 did not use or evidence any 
interest in programmed instruction. 

The firms and organizations listed in Section D of 
the bibliography all submitted additional information 
with their completed questionnaires. This type of assist= 
ance was appreciated and contributed to the development 
of the subject. Several individuals volunteered to assist 
in the research for my paper if they should be needed. 

The answers received in the survey far exceeded ex= 
pectations. Based upon past experience it was felt a 
return of 15 to 20 percent was very good. If the returns 
were between 10 and 20 percent, figures could be develop= 
ed statistically to make predictions for the study. 737 


questionnairs were sent out and 504 returns, or 68 plus 


92 


percent, were returned in a two and one=half month period. 
One company wrote a two page letter explaining why they 
could not answer the questionnaire and another company 
made any answers contingent upon receiving a copy of the 
research paper. 

47 Companies requested a copy of the paper when it 
was completed. This group included companies which; 


1. Had programs installed and desired the informa= 
tion for improvement of their own programs, 


ee Had a definite interest but had not installed a 
program as yet, and 


3- Did not have the program and it was necessary 
for the training director to do a selling job 
With management. 

An attempt — made to @otain 2 company evaluation 
of their programs in respect tos (1) training effective- 
ness, (2) dollar effectiveness, and (3) method in which 
it was used. 

Realizing that the questionnaire could not elicit 
all the information which might be useful, the last por= 


tion was available for comments, either pro or con, which 


would contribute to the research paper. 








QUESTION OTHER REMARKS 


Can answers to survey be So li 161 not marked 


CCE 38 teaching machine 


195 programmed text 
25 scrambled text 
9 other 
=| | 
Is training conducted 
during working hours. 
Figure 1. Survey Answers 
(See Appendix D) 















quoted? 


Has Feasibility study 
been conducted? 










What method of PI used? 


De supplement 
lectures 
74 alone 


59 reduction 


How is PI used? 





Has PI permitted reduc= 
tion in training persone 


nel? 





Does trainee proceed on 


PART III = APPRAISAL OF THE RETURNED QUESTIONNAIRE 
In order to properly examine all facets of the question 
in line with the statement of purpose,- each subject in the 
survey will be considered separately. The questionnaire in 
Appendix D from which figure 1 was taken, has been filled in 
with the quantitative answer received in the survery. 
Of the 504 returned inquiries, 49 percent or 246 grane- 


ted permission to quote any information they gave. 16] 


or. ante pe 5 
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were not marked and in those cases it was assumed that 
they did not desire to be quoted by company name. Of the 
97 negative answers 22 identified their company and gave 
their name and title in question 2. 

Question 3 was poorly worded for it Was assumed that 
a study would have been conducted in all cases befcre pro= 
grammed instruction was introduced. Several training dire 
ectors indicated that this was not true for their decision 
to use programmed instruction was based upon information 
received from other soe ae = As others pointed out, the 
results of the studies were not always in favor of the in- 
troduction of such a program. 24 firms indicated they were 
awaiting results of a study conducted by their own traine- 
ing department, by an outside organization surveying their 
company, or information furnished by a professional organe- 
ization. There were 139 companies which declared they 
had conducted studies as to the feasibility of installing 
programmed instruction and 20 disclosed they had not cone 
ducted their own survey prior to the use of this type of 


training aid. 


eran Many life insurance companies indicated the 
decision to use programmed instruction for sales training 
and product knowledge was the result of the evaluation of 
previous studies conducted by the Life Insurance Agency 
Management Association. 


See Appendix C, Chart II, Line 3. 
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18.4 percent, 7 out of 50, of the Life Insurance Com= 
panies were awaiting results of a study. This information 
was given in an address at the Life Insurance aAazency Manage= 
ment Association annual meeting in chicago, Tllinois the 
week of November 11-15, 1963. In his address Dr. Wallace, 
Vice President == Research, of LIAMA said: 


LIAMA did show that agents who have more knowledge 
(of life insurance) tend to have a higher persistency 
of business than those with less. 

It seems apparent that what is needed here is some 
method by which we could improve the general knowledge 
level of cur agents and, at the same time, free our mane 
agers from an activity which tney do not like or are not 
particularly well suited for and give them more time to 
do the sales training which is, or should be, their 
major interest and responsibility. 

How to accomplish the release of managerial time 
without lowering our knowledge level? For some years, 
your research staff at LIAMA has been concerned with 
this problem. We have been closely following the work 
Which has been progressing on what are called self-ine- 
structional techniques. There are many varieties of 
such techniques and some considerable differences in 
the theoretical structure upon which they are based. 

Thus far, most of the investigations of self-ine= 
structional methods have been made in the school (gramme 
mar, high, and college) or the armed forces setting. 
Generally, it has been found that for basic school sub= 
jects and for such knowledge areas as electronics, 
Weapon systems, etc., the self-instructional approach 
can make dramatic improvements in the knowledge level 
reached and in the time required to reach it. In fact, 
in the educational world there is some worry that the 
technique will replace the teacher too thoroughly=-a 
concern which, fortunately, we need not share. 

This evidence was strong enough to encourage us 
to investigate what this technique might do for our 
lndustry and, because most of the successful applicae] 
tions have been in the field of knowledge and because 
our problem in the area of basic life insurance knowe 
ledge I mentioned earlier, we decided to see what could 
be done there. 

We have invested a very considerable sum of money, 
LIAMA staff time, and time of agents, managers, and 
home office staff of some wonderfully cooperative com= 
panies in a research project to evaluate the tol uee 
structional technique in life insurance setting. 


5, Rains Wallace, "Steps Into Life Insurance." 
Presentation made before the Life Ins. Agency Management 
sig eee 7 aoe at the 46th annual meeting. November 14, 1963. 
P. 4, =T 4 
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Dr. Wallace went on to tell how thoroughly they had 
developed the course and recommended its use for the im= 
provement of salesmen'’s knowledge, an increase in sales and 
a freeing of the agency sales manager for other duties. 

If the decision of the seven insurance companies re= 
ferred to above hinged upon the recommendation or lack of 
recommendation by LIAMA, it would seem that they will con- 
sider introduction of programmed instruction in their train= 
ing. 

Question 4 (a) requested information on whether teach= 
ing machines were used and if so, who were the manufactur= 
ers and what were the models. 88 respondents indicated 
they were using some form of teaching nacho There 
were 19 different modeis listed that could be identified 
as to type and manufacturer. They varied from the moder= 
ately priced machines using printed media and requiring a 
written response to complex digital computer programmed 
and computer controlled psychomotor devices. The number 
of machines which each company had was not requested and 
elght of the companies failed to identify the model or 
manufacturer of their machines. 

A percentage of 48.6 of the companies using program- 
med instruction used some form of teaching machines. The 
comments concerning the advisability of teaching machines in 
a training program varied considerably. Mr. Harold Z. Mason, 


Manager Station Training, Trans World dAirilines:3 


OSee Appendix E. 





Teaching machines == absolutely note: While we 
do not have starts in our eyes, we are excited about 
programmed instruction. We are totally disinterested 
in teaching machines at this stage of development of 
same. We can, however, teach more in less time with 
PI. PI will never completely replace? 


1. <A teacher or instructor, 
2o Student demonstration of skills, and 
4. Need for student contact with a specialist. 


On the other hand a Corporate Director, Manager De- 


velopment and Training of an industrial firm reports: ' 


We have 32 teaching machines of ll different 
types for use in our five divisions. Each serves a 
special purpose and is an extremely valuable addition 
to our training facilities. In addition, we use proe= 
grammed and scrambled textbooks. We have not replace 
ed any training personnel by using any of these aids 
but we have doubled the efficiency of our teaching 
and are able to adequately handle many more employees. 


Mr. Robert E. Goche, Vice President, Greyhound Corp= 
oration expresses his opinion of teaching machines in this 


statements: 


Western Greyhound Lines, a division of Greyhound 
Corporation headquartered in San Francisco, is the 
first of our divisions to utilize teaching machines. 
Their acceptance of the Edex response teaching machine 
is excellent and the results have been extremely grate] 
ifying. 


As can be seen from the above quotations there is a 
great difference of opinion concerning the value of teach= 


ing machines even among advocates of programmed instruction. 


Cone Training Director quoted requested that he and 
his company not be identified by name other than the fact 
it was an industrial concern. 
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Question 4 (b) dealt with programmed textbooks. ‘The 
programmed textbook resembles a regular school text in tnat 
the material is presented in logical steps and does not ree 
quire the student to skip from page to page. The method of 
communication, however, does differ from the ordinary text- 
book. The material is presented in short paragraphs and 
the trainee is tested upon the completion of each small 
unit before going on to another point in the program. In 
Other words, the book becomes the hardware similar to the 
teaching feonimten” The survey indicated 193 programmed 
textbooks were being used. 46 companies denoted they had 
developed one or more of the texts which they Were using 


and 125 were purchased from publishing concerns.” 


Appendix 
F lists 26 concerns cited as publishers of the textbooks 
being used. In addition to those publishers, "Teaching 
Machines and Programmed Learning "*° list several additional 
companies supplying programmed texts. 

Texts for all courses are not available on the open 
market, 108 corporations employed consulting firms that 
developed courses especially for their use. The 712 courses 
reported in the survey, both in-house and commercially pre- 
pared, have been listed in Appendix G As can be seen 
some would have limited application while others could be 


employed by almost any concern requiring instruction in the 


Sor. ante., De 8. 


See Appendix E and F. 


105. s. Department of Health, Education & Welfare. Teach= 
ing Machines & Programmed Learning. Office of Education. 1962. 
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topic. Many of the programs that are developed by ccnsulte= 
ants are modifications of a general course designed to the 
specific requirements of the firm. Indications are that 
this type of change is relatively inexpensive while the 
complete development of a program will require a consider= 
able expenditure of time and manpower. 

Professional and trade organizations, such as the 
American Management Association and the American Institute 
of Banking, have entered the programming field also as an 
aid to members. This is possible with courses such as 
"PERT" and "Cost Reduction and Control for Supervisors” 
Which would have general application in most industries. 
Manufacturer developed programs, similar to the Internae- 
tional Business Machine Corporation's computer courses,are 
for use with a particular product regardless of the ind- 
ustry employing the training aid. 

The acceptance of scrambled textbooks has not been up 
to that of the regular programmed texts. Only 25 scrambled 
textbooks were indicated as being used. 6 were developed 
by corporation training divisions, 8 Were purchased from 
outside consultants and 14 commercially published programs 
Were used. Inasmuch as this totals 28 and only 25 texts 
Were reported as being used, i assume that some texts were 
developed by training departments in conjunction with cut=- 
Side consultants. 

The cost of scrambled texts considerably exceeds that 


of the regular programmed textbook. One text covering a 





complex operation is quoted at $152. Perhaps this accounts 
for the fact that commercial publishing concerns have not 
rushed into this type of printing. The scrambled text is 

a modification of the Crowder theory.++ I believe the re- 
latively small usage is a reflection of the increased pur- 
chase cost and not cn the value of the text as a method of 
instruction. 

The 9 types of programmed instruction reported under 
question 4 (d) were taped instruction. These were not de= 
scribed in detail so it is not known just what form these 
take. If it is just the use of a tape recorder to supple - 
ment a classroom lecturer, it is doubtful if this could 
properly be considered programmed instruction. 

The answers to question 5 are reported in Apvendiz G. 
In order to eliminate the listing of many similar titles, 
courses have, in some cases, been grouped under a general 
heading. 

In answer to question 6, which asked how the program-~ 
med instruction was used, 217 companies indicated the pro- 
grams were supplementing classroom lectures and 74 employed 
the programs as the sole instruction aid. As only 181 com- 
panies indicated the use of programmed instruction, the re- 
plies have to be related to the 306 instruction instruments.? 
Using this base, 71 percent are using the programmed instruc=~ 


tion as a supplement and 24 percent use it as the sole 


11 scrambled textbooks, cf. ante., p. 18. 


12g teaching machines, 193 textbooks and 25 scrambled 
textbooks. 
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med instruction as 2a supplement and 24 percent use it as 


the sole training device. There Were many comments to tne 


effect that programmed instruction should not be the only 


method employed and others that indicated certain courses 


would not require any additional assistance; 


lL. 


L. Re Lenarz, Manager, Production & Industirisi 
Pngineering, The Magnavox Company <-- Courses in 
"electronic wire and solder training" and "in- 
spection training" must be supplemented with 
lectures but “employee indoctrination" and "man-= 
ufacturing processes" are complete unto themselves. 
H. O. Holt, Director of Training Research, Jmeri- 
can Telephone and Telegraph Company -=- "Basic 
electricity" is a self-contained packase although 
some operating units are adding lab exercises; 
WATS and 20-40 DIALPAK (sales training) are selfe= 
contained. 

Ke Re Berkheimer, Supervisor, Electronics Traine 
ing, Lockheed-California Company <= Our courses 
are for background training and skills upgrading 
Galculus, Sets, Introduction to Electronics, 
Trigonometry, etc.) are used independently at 
present. A variety of approaches will eventually 
be used on courses that are to be added to our 
training progran. 

Thomas F. Higgins, Assistant Trainins Director, 


John Hancock Mutual Life Insurance Vonpsany == 
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Some of our courses teacn a cross section of enplovees 
with limited insurance knowledge the knowledge of the 
fundamentals of life insurance. Others are used for 
teaching computer programmers the basic principles of 
the IBM 1401 programming and staff personnel the PERT 
secnnique. They are used as the sole teaching instru- 
ment, except computer programmers also received formal 
classroom instruction in programming electronic data 
processing equipment. 

From this and other similar statements, I think it can 
pe safely said that whether a particular program is used as 
the sole method of instruction or is supplemented by some 
form of personal instruction will depend upon the subject 
and the group being taught. 

In answer to the question regarding a possible reduction 
of training personnel 26 companies, 14 percent, indicated 
they had been able to reduce a total of 59 personnel as a 
result of the introduction of programmed instruction. 104 
or 57 percent indicated that there was no reduction in per- 
sonnel. However, many qualified their answer in the follow- 
ing manner: 

1. Robert E. Britton, Director, Sales Training, The 

Seven=-up Company, Ste Louis -- No, not the intent 
of the program as nothing has been replaced. Pro- 
zsrammed material has been added to, and integrated 
into, present training programs with no additional 


personnel required. 








2, Selwyn Brent, Education Consultant, UNIVAC (Div. 


Th . a 


of Sperry Rand Corp.) -- Dred 


J 
[j~ e 


ately no, but long 


t 


range training staff reduction is more import=2nt. 
Systems Analysts double ss instructors and this al- 
lows them to concentrate on Systems Analysis. 

5 Robert Brink, Instructional Prozrams Supervisor, 
General Telephone Co., of California -- No, but 
time saved is applied to otner supervising require- 
ments. 

4. Harry G. Woodward Jr., Manager, Trainins Services, 
Interstate Bakeries Corporation <= No, but more 
training is done and there is no increase in the 
training st2ff. 

It would seem from these remarks that the total tr2in- 
ing dollars probably will nov decrease but the value re- 
ceived for the training dollar will be larzer than hed been 
the experience prior to the introduction of programmed in- 
struction. If a larger group may be trained the cost per 
trainee could be reduced. 


Question eight had to do with the method of instruction, 


Ps) 


specifically, was the student allowel to proceed at his owm 


e. The overwhelming answer to this question was Ye 
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126 or 70 percent were allowed to pace themselves and 11 


ercent, 21, were xept to a class pace. There was no indi- 


Ze 


cation given 3s to wnat courses were included in the 21 ner 


ative answers. 
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Pamililarization course yielded a 9.3% in- 


4 
74 


crease aS measured by the same criterion 


Tne Philadelpnis National Bank -- Our en= 
ployees have reacted enthusiastically to 
prosramied instruction, and studies made 
by our Loan Deoertment reveal much better 


retention by those wno have taken the P.I. 
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savings in training hours and/or dollars? 
a. FP. L. Docken, Training Director, Tne Mayvec 


Soe, -= We have definitely proven that P.I. 
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will save training hours on wire nAsrness 
training by operating people. 

bs Robert 2. Royce, Irainineg Consnubtana, 
Atlantic Refining Company -- Saves a few 
minutes of supervisor's time, but what is 
more important, insures trainees get tausht 
Simple tasks that the supervisor is apt to 
forzet. 


Cc. Oo. W. Planders, Corvoration Manaser Train- 


j—- 


ne, Sprague Electric Co. -- Isolated train- 


ii 


canbe 


03 


problems have been solved and svot train- 


ing may be done easier and faster. 


\g 


ad. Ralph W. Walker, Supervisor Prosrammed In- 
struction Unit, Martin So. (Denver )--Yes, 
the Titan II Familiarization course yielded 
a 30% student savings when administered to 
site and field personnel. Also a 34% re- 
duction im students time, 

Can you cite results of training cost per stu- 

dent or course of instruction with programmed 

aids vs other forms of training? 

a. George L. Germain, Supervisor - Develooment 
3 Trainins, Lukens Steel Company =-= About 
13 hours of trainings time ver student saved 
versus a relatively inexpensive course cost 
per student (4MA's Cost Reduction and Jon- 


trol for the Suvervisor) because they do the 
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vrogram on a voluntary basis on tneir oim 
time. It holds their interest and makes 
"homework" more challenging. 

Everett Le. Smith, Coordinator of Training, 
Sunray DX O11 Coe, -- There is a@ much small- 
er cost involved on the amount of programmed 
instruction being used at this date. 

Norman R. Miller, Training Supervisor, 
Westinghouse Air Brake Co. \-- If off the 
shelf programs can be us3d, there is a tre- 
mendous savings in course develovment time 
for classroom instruction. 

Bennett Dolan, Training Systems Manager, 
Security First National Bank of Los Angeles 
-~Permits high quality training in outlying 
branches; not economically possible any 


Other way. 


Can you cite any results of employee attitude 


of lecture type training as contrasted to pro- 


erammed instruction? 


Ae 


Walter ©. Gaipa, Associate Director of Field 
Training, Field Training Div. -- District 
Agencies Dept., Prudential Insurance Co.-- 
Trainees overwhelmingly prefer F.I. 

James H. Kearney, Training Assistant, The 
Mead Corporation -=- Trainees desired more 

of this type of training plus wanting more 


advanced coursese 
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manner of conduction the »vrogzranmsd instruction 


John He Stetson, Director of Yraimiig rarst 


7, 


National Bank of Bostone-From the instruc- 
tor's standpoint there is a noticeable dif- 
ference in the understanding cf the groun tc 
the subject matter presented --because tne 
trainees have the background, through the 
Programmed Instruction, to follow more easi- 
ly the application to their situavion. 
Re Ws Rolfe, Chief, Education and Training, 
Northrup Norair -- Barly questionnaires in- 
dicated 25% preferred lecture, 25% had no 
preference, and 50% preferred porocrammed in- 
struction. Findings at this time indicat 
tnat programmed instruction will offer wore 
complete subject mastery and sreater class 
flexibility at lower cosi. 
Dale R. Mcodracken, Industrial Ensineer, 
Champion Spark Plug Co. \- Prorrannedc traine 
ing is acceptea much more readily by employ- 


ECSe 


The following answers were received to question ten ree 
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Number Percens 


1. Compulsory 108 59.677 
Z 
2. Voluntary 85 47 Qt? 
3e If voluntary, avproxinate 13 cited percentages 
% of participation ranging from 10% to 
98%. AVE 9 61%. 
4, On a continuing basis 61 35.7 
5. Upon initial employment 52 23-7 


6. Whenever an employee is 
introduced to a new func- 


tion or process AL 2228 
7. <At regularly scheduled 

periods. 47 25.9 
8. During non-working hours 48 26.5 
9. During working hours el 16.12% 


In the quotations I have given from the returned quee- 
stionnaires, I have, of course, presented a biased victure 
taken from the 36 percent who have advised that they are 
using programmed instruction. I endeavored to select those 
answers which answered the question best and avoided, wher- 
ever possible, more than one quotation from the same source. 
It was hoped that this last factor would better indicate the 
acceptance of programmed instruction and at the same time 
point out some limitations. 

Question eleven requested additional comments, eitner 


pro or con, which would contribute to the research project. 


1 overlap in the above instances is due to multiple course 
es being offered within a company of either category. Had the 
question been answered by all 181 corporations the overlap 
would have been considerably larger. 


lt onis question was not specifically asked but 21 indi- 
cated that instruction was conducted during working hours. My 
guess would be that the answer to the question would have been 
approximately 75+ percent indicating an overlap azsain. 
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Inasmuch as many of the best comnents are also from the 
persons who have been previously quoted, it will be nec- 
essary to repeat some of the sources in order to prescnt 
a complete picture: 
1. Philip P. Miller, Assistant Vice President, Dir- 
ector of Training, Crocker-Citizens National sank. 
--Under programmed instruction there is a renewed 
interest in training that is not evident under 
lecture type training. 
ec» Dean D. Osborne, Supervisor of Development and 
Training Supervisor, I. W. Bliss Company -- We 
could write programmed instruction but time is 
of the essence. Like color TV, texts will be 
fortncoming at @ reasonable figure. Our company 
developed 2 program over a year and one half per- 
iod and now a text is available on the merxket. 


om | 


3. Clarenee W. Glud, Geeral Training’ sper yer, 


Rayonier Incorporated.-=- Seems to be of most 
value for individual instruction when the size 
of the class would not justify the expense of an 
instructors @ome students asremable toer1t tier 
studies into slack periods during workins hours 
rather than be taken away from the job when ur- 
gEent work assignments are pending. 

4, Jack D. Robb, Manager of Trainins, McDonnell dir- 
craft Coe -=- I feel the programmed text is rood 


but must be supplemented with film, discussion 
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periods, lab (wnere applicable) and tests to deter- 
mine achievement. It is erroneous to believe the 
teva in most cases, by itself distributed to a 
sroup will ve effective. 

Gordon M. Rhodes;, Assistant Cashier, Personnel - 
OperationS» First National City Bank of New York 
Jity -- /e are completely satisfied with efforts in 
Prosrammec Instruction over the vast three and one 
habS! yGaycm We nq@ leoneer aig bize outsbde.comsult- 
Sant companies but instead have an internal program- 
mingwgection consisting of three programmers 2nd one 
Clerk with the imbent Of fumether utilization of pro- 
grammed instruction as an adjunct to our convention- 
al training methods. In all areas of utilization, 
students achieve completion of the course material 
in shorter periods of time and attain maximum train- 
ee output in approximately 50% of the time it forn- 
erly took. 

Re Es Sliversge Tradning Director Micro Switch Dia 
Honeywell Corporation -- To date, we have mainly 
used programs of general nature in basic areas 
(slide Ruleg Calculus§ Memo Writing; PERT). One 

man has been prepared to write programmed material. 
As of now he has one short program on solder train- 
ing completed. We feel that well done programs 
properly applied will pay real dividends to any 


company working in the training area. We still are 








of the opinion thet tailored or modified programs 
are too costly for most small sized training jobs. 
George L. Germain, Supervisor - Development & Train- 
ing, Lukens Steel Company -- The way @ program is 
used is as important as the program itself. No 
training, programmed or otherwise, will be very 
successful without active interest of management 

and proper, continuing follow-up. 

James M. Yasinow, Training and Development Advisor, 
Cleveland Electric Illuminating Company -- [I be- 
lieve programmed instruction has its place, but it 
is only one tool of many available to trainers. Al- 
though some trainers are flocking to programmed 
material as though it Were a panacea, I do not share 
their unbounded enthusiasm. We use programmed ma- 
terials quite selectively. Much of the programmed 
material available today I consider to be overpriced. 
Much of it is of real value, in terms of reduced 
training time and effective results. If it meets a 
need, then programmed learning can do a job. Mater= 
jal which doesn't meet your need is worthless. 

Ralph E. Giles, Assistant Director - Personnel Dev= 
elopment Division, Continental Oil Company <= The 
refinery operator is a shift worker, because of a 
degree of automation, the operator's presence is re- 
Guired but he is not busy all of the time <= only 
when the unit is upset, or starting up, or coming 
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Or 


When an operator is pulled off the job for class- 
room instruction, he must be replaced by holding ov- 
er the operator of the prior shift for half of the 
vacant shift, and calling out early the operator 
from the following shift for the other half of the 
vacant shift. 

This means overtime. Manhours in classroom cost 
time and a half! Programmed instruction permits 
technical upgrading of operators on the job without 
interference with normal duties at no cost beyond 
the materials. 

Programmed instruction has not only reduced time 
and dollar cost of old training, but permitted new 
training that was formerly prohibitive in cost. 
Ralph E. Boynton, Vice President, Training Depart-~ 
ment, Bank of America -= The accelerating require- 
ments for employee development programs have been 
generated primarily by organizational growth and 
technological change. Meeting these requirements 
demands that traditional instructional methods re- 
ceive substantial subsidization from media which (1) 
utilize the proven principles of programmed instruc- 
tion, and (2) incorporate the inherent advantages 
of audio visual applications. 

The Bank of America is presently investigating the 
feasibility of extending tne application of these 


techniques to a variety of other areas, including 
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teller training, proof machine overation, and inter- 
national banking. It is emphasized tnat prosrammed 
instruction, teaching machines, et al, are regarded 
as a means for more adequately supporting, not re- 
placing, instructional supervision. 

il. Fo. Me. Nadolny, Supervisor, Training and accident 
Prevention, Duquesne Light Company == We started 
programmed instruction in subjects where best ap-~ 
plicable. This type instruction ensures that all 
the details are covered, however, we often supple- 
ment with lectures to clarify certain points. MWe 
have found programmed instruction very effective 
for our type training and plan to develop addition- 


al courses. 
I have cited in Part III, 38 executives who are directly 


concerned with training. In order for them to have made “ays 
statements I have quoted, it was necessary for them to have 
evaluated the companies’ training requirements and goals, the 
avallable methods and the cost and effectiveness of the methods. 
18 different industries are represented in this group to give 
as large a cross section as possible. 

712 courses have been programmed by or for 181 commercial 
enterprises. If these successful firms feel that the dollars 
expended for training contribute to profit, it can be assumed 
that there is a value to be gained from uSing programmed in- 
struction. 


The Training and Education staff of the Industrial Rela-~ 
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tions Department of the Mead Jorboration conducted 4 survey 
in earlv 1963 similar to this one. They sent 137 suestion= 
nalres to randonly selected companies in severai industries. 
of the Tl replies received, 29 or 41% reported the use of 


yrosraumed materials. This 


Smt @ 
49) 

Cue 
co 
wa 
et 
oa 
eg 
- 
ct 


more than the per= 
centage (39%) that answered aff 
There were Gifferences in some of the details out the coore= 
Lation between the two independent studies was remarkadle., 
A similar study made in mid=1962 by Gordon J,. Lippitt 
and dayne N. Schelle and reported in the Journal of the 
dnerican Society of Training Directors in November 1962, re= 


vexled that only 20 percent of the members of the Society 


wer Sing programmed instruction selectively or only occa- 
— 15 nee * nee 
SLonally » It is not knowa how many of the ormanizations 


contacted in this study are members of the nerican Society 
of Training Directors. It would not be unressoneble to ase 
sune that most of the companies weuld nave been included in 


meoeeist OL (Sf corporations, 


1 Rex FB. Sheets, Dom ramirez and James H. Kearney. 
"Prosrammed Instruction.’ Notes from a sanel discussion 
bresented to the Annual Conference of the American Soclety 
of Training Directors, May 6, 1903. 


16. * ~ ~ e = . 
David B. Story. "Programmed Instruction ang Its 


Importance for the Training Section.” Industrial 2elations 
Training Section Bulletin of the Boeing Corpersatiion, June 
MO 50 VD Gs 
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I feel that this is an indication that the number of 
firms realizing the value of this media has increased and 
will continue to do so in the future. 

The factors limiting the use of programmed instruction 
in the Lippitt and Schelle study nonete | 

iow Hicheiastialecost, 

ce Smail population to train 

3. Low turnover 


4. Not suited to work involving judgmental complex- 
ities 


5. Programs not available which are needed or easily 
adapted 


6. Rapid obsolescence causing rewriting of programs 

7. Difficulties in programming 

8, No existing need 

9. Lack of interest 

Some of these reasons were cited in the negative re- 
turns received in this research questionnaire, however, the 
reason for not using programmed instruction was not directly 
requested. The 34 returns, which indicated a study had been 
conducted and the results disclosed that the introduction of 
programmed instruction would not oe practical, gave as a 
reason a variation of 1 through 9 above. 

Further information received in Society of Training 
Directors survey concerned the attitudes towards program- 


med instruction and the advantages and disadvantages 


1’ pavid B. Story. "Programmed Instruction and Its 


Importance for the Training Section." Industrial Rela- 
tious Training Section Bulletin of the Boeing Corp., 
jae 1965.6 pp. 10. 
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attributed to automated teaching. ‘The summary of these were 
as Penalors © 


ADVANTAGES OF AUTOMATED 


TE ACHING 
Advantages Responses % 

Standardized instruction .... 78 27 
Faster learning «=<. 29s 2 « ws 68 23 
Increased retention «.« 6 e« « « e 40 14 
Increased learning jibbe se 2 8 Oo 42 14 
Cost reduction ee 2 © « « © e eo » fl) ) 
All of these <«: 2 20%  “ ite 6 ce oul stb 
Mone of these Was © as « =. . 6 ne 

Total 4 « «wee. w@ wm 292 LOO 


LIMITATIONS AND DISADVANTAGES 


Disadvantages Responses % 
Difficult to program the mat'rl 105 33 
Impersonal & loss of human element 98 35 
Hiener Cost tatis « « ou Siamese Neemnor 18 
Lack of student interest ..-e. 13 5 
None of these ce e e © «© « «© © « » 6 2 
Leneth of trainime “e . s 6 4 ss 4 1 
All of these o e« © «© «© © « @ « ee 1 

Total <& « ~~) eb eluents "enemmcoe 100 


The necessity for adequate programming of material 
Was stressed in the earlier part of this paper. ~? As 
to whether or not this should be listed as a disadvante-e 


age is questionable. 


13 Teds, pape 15. 


19 cf. antee, pe 1O 
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pecause 2 task associated with training methods is difficult 
te perform or unfamiliar, it should not necessarily be a cri- 
teria in determining the value of the media. It is the end 
product which must determine the advisability of implementa~ 
tion. These same disadvantages Listed above appeared in my 
study. In my opinion the advantages, in both studies, defin- 
itely outweigh the disadvantages. Therefore, I feel that the 
results of the two studies cited above further substantiate 
the results obtained from the questionnaire sent out in cone- 


nection with this research paper.<> 


0 See Appendix aA 
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CHAPTER IV 
NAVY “XPSRINCE WITH PROGRAMMED INSTRUCTION 

The use of piogrammed instruction could have potentially 
important sugnificance in military training. Military train-= 
ers are faced with 2 short span of training time as well as 
a heterogenous group of trainess. It is doubtful, however, 
if the trainees would be decidedly different thatn would be 
experienced by a large corporation at one of the plants em= 
ploying in excess of 5,000 people. The selection process for 
technical schooling in the Navy is supposed to be based upon 
a psychological evaluation of such things as the General Class= 
ification Test and other aptitude tests that are given. Sup= 
posedly a person with just above borderline intelligence 
would not be selected for a technical shcool requiring consi- 
derable mathematical skill. On this assumption, it may be 
conculded that the bulk of the technical trainees have the in- 
tellectual ability necessary to attain some measure of success. 

The United States Navy has made several evaluations of 
teaching machines and programmed textbooks. The first use of 
@ teaching machine occured during World War II. A "pinball" 
type machine was used for teaching aircraft recognition and 
rules of the road in an effort to accelerate instruction. The 
student was given a multiple choice question on a punched 
plastic card and was to press a button corresponding to his 
selection. A correct answer received a green light allowing 


the student to go on to the next question and at the same 
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time registering a numerical score which took into considera-= 
tion response time. An incorrect score meant a red light and 
the student was to make another choice. The effectiveness oi 
the machines was never scientifically proven and due to cost 
and maintenance problems the machines were not utilized fol= 
lowing World War II. 

The work being done by Skinner and other educational 
psychologists in the late 1940's and early 1950's renewed in-= 
terest in the teaching machine as an instruction aid. The 
U. S. Naval Training Devices Center has undertaken several 
studies as well as contracting with civilian institutions for 
research in the field. 

An early project by the NTDO was the design and field 
testing of the "Green Light Rater” in 1958. Basic consider= 
ations of the device are practicality and psychological vale= 
idity. The Green Light Rater is inexpensive, adaptable to 
physical environment of trainees, requires minimal mainten-= 
ance, and has the advantage of allowing the using activity to 
prepare and install its own questions. ‘Trainees are presented 
With an array of forty two (six rows, seven columns) of 3" x 
5" cards. Each card has a multiple choice question with four 
alternative answers and a row of correspondingly numbered 
buttons below the card. Buttons glow red if incorrectly pre= 
ssed and green if correct. Its psychological validity is 
based on incentive motivations, knowledge of results, repeti-= 


tion, contiguity, distribution, incidental learning, and lack 
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of stress. As to its value as a method of presenting matere= 
jal for review, it is more of a “gimmick” than a training 
aid or device. 

another test was conducted by the Guided Missiles School, 
Dam Neck, Virginia in an effort to determine if the attrition 
rate at the school could be reduced. Six of the Auto Tutor 
Mark II Machines (projected media/key response) were made a= 
vailable for the use of the students for remedial and refresh= 
er training in algebra, trigonometry, electricity and the use 
of the oscilloscope. The machines were used for a one week 
period employing off the shelf programs rather than Navy de= 
veloped and oriented material. The value of the machines was 
not conclusively proven. It was surmised that there was some 
benefit but no attempt was made to document and statistically 
support that supposition. 

The British Navy did conduct controlled evaluations of 
the Auto Tutor and Tutor Texts for Naval instruction in trig- 
onometry to compare automated and human instruction. Three 
eroups, one using the Auto Tutor, one using Tutor Texts (a 
scrambled textbook) and one receiving conventional classroom 
lectures, Were given a six lesson syllabus to be completed in 
a nine hour period of instruction. The groups were pre-select= 
ed on the basis of prior education, mathematical ability as 
determined by testing, age, and intelligence quotient. 

Both groups using the programmed instruction completed 
their six lessons in less than the nine hours allotted (a 


mean of 5.6 hours for the Auto Tutor and 5.5 for the Tutor 


lealine, S.C. "Teaching Machines for Navy Use." A 
research paper submitted to the U. S. Naval Postgraduate 
School, Oct. 1962. ; 
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Text) while the classroom instruction groud was able to fin- 
isn five lessons in the nine hours. Examinations at the como- 
letion of the course showed grades slightly higher for the 
Auto Tutor group but it could not be called significant. A 
reexamination designed to measure retention conclusively 
proved that the retention rate of either of the programmed 
instruction groups was substantially superior to the class= 
room group. 

Based upon the controlled factors and method in which 
the test was conducted, it should be safe to assume tnat the 
test did indicate an advantage in iength of learning time 
and retention of programmed instruction over human instruc- 
tion. A questionnaire given the three groups did reveal that 
the programmed trainees felt they preferred the conventional 
teaching methods. This was especially true in the case of 
the group using Tutor Texts. 

An experiment similar to this was conducted at the U. S. 
Naval Service Schools Command, Great Lakes, Illinois by a 
research psychologist from NDTO using Min/Max machines, a 
printed media written response type machine. Courses for 
AC electricity, DC electricity, refresher mathematics and 


calculus were evaluated under the following conditions: 


1. A comparison of programmed instruction and closed 
circuit television. (As an aside the Dept of 
Health, Education,& Welfare considers closed cir= 
cuit television can be classed as a form of pro= 
grammed instruction. )@ 


2. Programmed learning as compared to human instruction. 


i. S. Dept. of Health, Education, and Welfare. Teach- 
ing Machines and Programmed Learning. Washington D.0.: Ofc 
of Education, U. S. Dept. of Health, Education, and Welfare, 
19621 p. 49. 
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3. Effectiveness of assignments outside class using 
programmed texts and conventional texts. 


It was generally concluded that tne results obtained in 
this experiment were similar to those obtained by the 
British Navy. The effectiveness of instruction as measured 
by retention was relatively the same when comparing programe 
med instruction to what are considered convential methods of 
instruction. In the area of instruction time it was quite 
evident that time savings were possible using the programmed 
instruction type methods and materials. The group using the 
programmed texts gained a significantly increased grasp of 
the material in the assignments outside the classroom envir= 
onment o 

an Evaluation of all Navy conducted experiments by the 
pngineering Psychology Branch of the Ue S. Naval Research 
Laboratory revealed that programmed instruction in the Navy 
has one of the same faults as proven conclusively in civil- 
jans trials. If the program being presented has not been 
carefully and effectively prepared the value to be received 
is next to nothing.” It was decided that any Naval activity 
engaged in training could give the maximum training in aca-~ 
demic subjects in the minimum time if programmed instruction 
were employed. The additional time available to instructors 
could be utilized in constantly improving the programse Fure- 
ther, it would allow instruction based upon exception -= that 
is devoting instructor time to problem areas rather than 
routine matter which could be conveyed by use of programmed 
ese Fa On 

"Birmingham, He Pe, Re Chernikoff, and P. N. Ziegler, 


"an equalization Teaching Machine." Naval Research Lab. Rpt. 
5855, Nove 1962. ppe 6-6 <5 
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CHAPTER V 
CONCLUSIONS 


It is estimated that U. S. corporations now spend as 
much as $2 billion a year to train their employees == for 
American Telephone and Telegraph alone the bill is well in 
excess of $75 million. The three million non=college grad-= 
uates predicted to need professional and technical training 
in the next ten years may have to rely in part, on industrial 
instruction.~ Programmed instruction will be expected to 
bear an increasing amount of the training load for it is not 
just another in a long list of training fads. Proper evalue 
ation should be made of its place in the training structure 
and the director must insure selection of adequate materials. 
This medium seems to have promise when assigned a prover 
niche. Confidence is being placed in this instrument to 
assist in solving such problems as unempioyment and the 
training of displaced labor resulting from the continual 
changing technology. 

This study has shown that programmed instruction, in 
its many forms, should be an asset in most training situae- 
tions. It is not a cure-all but it has a place when properly 
evaluated and adequate programs are utilized. It is doubtful 
if a reduction of training expense will result if programmed 
instruction is used, although the amount of Seat and the 


educational value of the training should increase when equated 


spencer Klaw, "What Can We Learn From The Teaching 


Machines?" The Reporter, July 19, 1962. p. 23. 
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to the cost of programming and associated hardware. However, 
With a significant number of trainees the cost per trainee 
could be considerably reduced. 

It is my opinion that the Bureau of Naval Personnel and 
the Naval Training Devices Center could profitably investigate 
some of the courses presently being offered to commercial ine- 
dustry. There are definitely several commercial courses that 
would have a high coorelation with training courses being of- 
fered enlisted men as a requirement for promotion. 

It would seem that the installation of some type of ine= 
expensive teaching machine aboard naval ships and stations | 
for presenting programmed training courses would have a poe 
tential of increased training at a cost very little in excess 
Of present expenditures. With the present trend in reduction 
of petty officer advancements, it is essential that the in= 
creases in rate go to those who are best qualified. 

If the caliber of the candidates and the interest dis= 
played could be increased through programmed instruction, 
the Navy might find that it has an assist in some of the 
problems set forth in the Dillion Report (e.g. adequate maine 
tenance). 

Increased retention in technical rates such as those 
involved in the repair of electronic instruments, gyroes, 
radar, etc., would tend to offset the additional cost. In 
the clerical rates such as storekeeper, yeoman, and person= 
nelman the amount of information dispensed could be increase 


ed having a multiple affect in amount of retention, one of 
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the benefits of programmed instruction. 

With additional training the talent now employed in deve 
loping the training courses could possibly be channeled into 
programming. The cost of training programmers would be minor 
When it is spread over the number of personnel participating 
in the training programs leading to advancement in rate. 

In conclusion, it would seem that the advantages of and 
benefits to be gained from programmed instruction, both in 
the Navy and in civilian industry, indicate future growth. 
The objective would be to use programmed instruction as an 
adjunct to present training aids. As the science of train= 
ing progresses, under proper conditions program instruction 


will contribute a greater share to its efficiency. 
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APPELDIX A 


U. S. Naval Pestgraduate School 
Box 2654 
Monterey, California 


6 2 partial requirement for 4a *Master’s Negree in Managemenr 
ae one U. S, Postgraduate Sie tT am conductive 4 research project 
in the epplication of pregrammed instruction aids in Industrial 
iva ining : 


The attached survey is being mailed to the following Corpora- 
t 


tn 
ct 
© 

Cs 


{ 


a) 500 largest U. S. Industrial Cerporations (as 
in the July, 1963 issue of FCREUNE magazine 


oe 
Ne Po 


6b) 50 largest U. S. Conmercial Bool 


“NX 
4) 


? 


c) 50 targest U. S. Life Insurence Cowpanies,. 


“<x 6 


qd) 50 Jargest U. S. Merchandisine Firms. 


is 


if 
Nu 

st 

oO 


- & ee and e} as Listed 


? 
on oa sss ; . 
vie ECRTUNE inagazine. 


largest U. S. 
in the August, 


Y would sincerely appreciate your cempleting ihe cucstionnaire 
and returning it in the franked self-addressed envelope. Any addi- 
tional comments vou might wish to wake concerning programnea in- 
struction will be welcomed, 


your firm does not use any type cf prograsnmed instruction 
ids ould still appreciate a return of the questionnaire, marked 
with this fact, to determine the extent to which these aids are 
being employed. if a study has been conducted which incicates it 
would not be practical to use this type of training sid please in- 
dicate this fact in the remarks section, #11, ¢f the questionnaire. 
TE progranmed instruction has been employed previously and then 
abandoned as not being practical vlease indicate in #11. 





{\2 


ws 


QUESTICNNATRE 


“S| Lie AP 


FCR USE IN A SURVEY OF 


PLICATION OF PROGRAMMED INSTRUCTION AIDS 


IN INDUSTRIAL TRAINING 
tiny the information given in this questionnaire be quoted in the 
research paper? Wo attemnt has been made to code any survey form. 
pays 





T£ the answer to #1 is VES, 


Gi 


Nes your firs conducted a 





procramaad Lastruction? 

bg Dow 

co 

Tf YES in +3 above, 

a) Teaching Machines 
1) Manufacturer 


h.2 
Vw 


Model 


b} Programmed textbooks 


Subjects 


2 


Developed vy 
Consultant) 


3 


Purchased fro oirb 


ia} )6=6Puplisher 


®. 


2a) Author 





Developea by your tr 


outsiae source 


cm 


ae 


please give your name, title ana £ 


stucy into the feasibility of employing 


what type of programmed instruction is employed? 


me em Ah RS 


SO ee RS a OR Ee rE Seen Gee 


e e BI 


aALmane aepartment 





‘e.g. John Jones, 


oo = 





Lishingeeence ties 


a Ae hE CE NE 
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6. 


4 « : 
c’ Scrambivg tageibonis 


4 Ce a ee Cee ee 


7 


i.) ISubyects 


ah OR UR it a. ANS 





Hea0actuent 


4 
i a a Oe ee 


2) Developed by your erair vin 
3) Developed by outsis2 source (@.%.Jchn Jones, 


Consultant) 





4) Purchased frou nublishing concern 


la) Publisher 


ES riya Ee ee ee em 


2a) Awtker 


& SCcher Tye 


meee “8 er fe ee ee ee 





1) Manufactnrer or Publisher 


A Ei ES 


ee ae ee ee ee -  o . 2 ee ee) ee 


For what type of instruction is the progvamae. aid used? (2.2. 
Prudential Life Insurance Cc. , wses™teqehin2 Machines fOr inst aac 


tion cf sales rsonn2l; Bughes Aiveralt wscs teaching i aehineseon 


a 
4 


alectronics assenbly line precess; Schering Drug Cornovation uses 


1 1 


programmed textvooks for proficiency in drug knowlecce for s 


> 
ito) 


03 


e 


Sell Telephone Laboratories for introductory electric- 


re) 
(> 
r 
3 
dD 
es | 
3 
@ 
a | 


pele 


ity; Humble Qil Company for servi 


upplement classroon instruc- 


C3 


F nd 


Is the programed instruct on used fo 


tion or used solely by itself? 
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ce si®tion operation Crainines:; Stew. 





10. 


Has the employement of programmed instruction permitted a reduc- 


tion of personnel used for training? 


YES 


NO 


If YES. How many 


Is the studemt allowed to proceed at his own pace? 


YES 


NO 


Can you cite any results of: 


a) 


b) 


c) 


d) 


Is 
a) 
b) 


c) 


Effectiveness or lack of effectiveness of programmed instruc- 
tion vs lecture training. 

Savings or lack of savings in training hours and/or dollars__ 
Training cost per student or course of instruction with pro- 

grammed aids vs other forms of training. 

Employee attitude of lecture type training as contrasted to 


programmed instruction, etc. 


the training conducted (check all that are applicable): 
Compulsory 
Voluntary 


If voluntary, approximate percentage of participation 


76 





d) On a continuing basis 
e) Upon initial employment 


f) Whenever an employee is introduced to a new function or process 


g) At regularly scheduled periods 


h) During non-working hours 


ll. Any additional remarks, either pro or con, which you feel would 


contribute to the research project. 
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APPENDIX 3 


le Total Sampletsige = on 


: 

1) 500 Largest U. S$. Industrial Corporations. 
cD 

2 50 Largest U. S. Commercial Banks.~ 


3) 50 Largest U. S. Life Insurance Compas. 


4) 50 Largest U. S. Merchandising Pirms.* 


5) 50 Largest Ue S- Utilities.-/> 


6) 37 Selected Concerns. 


LRORTUNE, "The Fortune Directory ~= The 500 Largest 
Industrial Corporations," July 1963. p. 177=196. 


q 


“FORTUNE, "The Fortune Directory == Part II," august 


1963. De 139-150. 


17 of the Utilities listed in Fortune advised they 
were holding companies. Of this number 8 passed the 
questionnaire to a subsidiary corporation for reply and 
9 returned the questionnaire marked "not applicable 
because the number of employees would not support the 
use of programmed instructions. 


tre luded Airlines, Railroads, and other transport= 
ation concerns, and large corporations not listed in 
Fortune because they do not divulge financial information. 


Fm 





1 % of 
Returns 


| 2. Questionnaires returned -- 504 
: 36.0 


a) Programmed instruction is being used 





A study is being conducted but results 
are not yet available 











Study is being considered and/or 
definite interest by corporation 










A study has been conducted. Results 
indicate that introduction of program- 
med instruction would not be practical 







Programmed instruction is not being used 
there was no indication a study has been 
conducted, and no interest shown. 






Returns 


£) No reply 
Total Sample 


ee listed were (1) too few employees 
(2) too expensive to implement 


(3) not enough repetitive elements to warrant 
the expense of developing a program, etc. 
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APPENDIX C 
CHART I 


Questionnaire Return Recapitulation: 


% Of % of Total 
Number Number Sample Returns by 
Sent Out Returned Returned Class 
1. Industrial 500 249 49.8 49.4 
2. Banks 50 30 60.0 5.8 
3. Life Insurance 50 38 76.0 7.6 
4. Utilities 50 37 74.0 7.95 
5. Merchandising 50 19 38.0 Jee 
6. Miscellaneous _37 N/A? nial N/A’ 
Total Question 137 
7. Unknown a 131 26.0 
Total Returns 504 68.4 100.0 
8. No Reply 233 31.6 


Miscellaneous figures for Columns 2, 3 and 4 are included with 
Industrial. 
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CHART IIL 


Breakdown of Industrial Returns by Answer 


Await- Not 
Being Inter- ing Feas=- Not 
Used ested Study ible Used Total 
l. Aircraft Constr. 6 2 8 
2. Heavy Equipment 9 3 2 12 26 
3. Aerospace 4 1 2 7 
4. Drugs 7 1 & 12 
5. Petroleum 9 l 2 1 4 17 
6. Office Equip. 3 1 4 
7. Household 

Appliances 2 2 

8. Electronics 8 1 4 13 
9. Meat Packing 1 1 ~ 6 
10, Chemicals 4 1 1 1 4 11 
ll. Food Processors 3 3 1 12 19 
12, Automotive 3 l 2 6 
13. Metals Prod'n 5 3 7 15 
14, Transportation 6 1 1 8 
15. Clothing/Cloth 4 1 3 8 
16. Electrical 3 3 
17. Beverage 1 1 1 3 
18. Cosmetics 1 1 2 
19. Paper 2 1 5 8 
20. Packaging Zz 4 6 
21. Bldg. Mtrs 5 5 
22. Glass Products 2 l 1 2 6 
23. Miscellaneous 18 = _l _4 29 60 
TOTALS 99 26 _6 12 106 249 


2 
Industries appearing in line 23 cannot be categorized as was the 
case in lines 1 through 22. 
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APPENDIX D 
QUESTIONNAIRE FOR USE IN A SURVEY OF 
THE APPLICATION OF PROGRAMMED INSTRUCTION AIDS 


IN INDUSTRIAL TRAINING 





May the information given in this questionnaire be quoted in the 
research paper? No attempt has been made to code any survey form. 
YES 246 Not Marked 161 
NO 97 
If the answer to #1 is YES, please give your name, title and firm 
name , 
Has your firm conducted a study into the feasibility of employing 
programmed instruction? 
YES 139 
NO 20 
If YES in #3 above, what type of programmed instruction is employed? 
a) Teaching Machines _ Used by 88 Respondents 
1) Manufacturer See Appendix D 
2) Model 
b) Programmed textbooks 193 


1) Subjects 





2) Developed by outside source (e.g. John Jones, 


Consultant) 108 





3) Developed by your training department 46 


4) Purchased from publishing concern 125 
la) Publisher 
2a) Author 





Bo 





c) Scranvled textbooks 25 
1) Subjects 
2) Developed by your training department 6 


3) Developed by outside source (e.g.John Jones, 
Consultant) 


4) Purchased from publishing concern 14 


la) Publisher 


2a) Author 
d) Other Type 9 (Taped Instruction) 
1) Manufacturer or Publisher 2 


2) Subjects 
For what type of instruction is the programmed aid used? (e. 8. 
Prudential Life Insurance Co., uses teaching kmachines for in- 
struction of sales personnel; Hughes Aircraft uses teaching machine 
on electronics assembly line process; Schering Drug Corporation uses 
programmed textbooks for proficiency in drug knowledge for sales 
personnel; Bell Telephone Laboratories for introductory electricity; 
Humble Oil Company for service station operation training; etc.) 

See Appendix G __ 

Is the programmed instruction used to supplement classroom instruc- 


tion or used solely by itself? 





Has the employment of programmed instruction permitted a reduction 
of personnel used for training? 

YES 26 

NO 104 

If YES. How many 59 
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10, 


Ll, 


Is the student ailowed to proceed at his own pace? 

YESTaIZ6 

NO. 21 

Can you cite any results of: 

a) Effectiveness or lack of effectiveness of programmed instruction 


va lecture training. 





b) Savings or lack of savings in training hovre and/or dollars 





c) Training cost per student or course of instruction with program- 


med aids vs other forms of training. 





d) Employee attitude of lecture type training as contrasted to pro- 


grammed instruction, etc. _ 





Outstanding Examples Cited In Chapter ILI 
Is the training conducted (check all that are applicable): 
a) Compulsory 108 
b) Voluntary 85 
c) If voluntary, approximate percentage of participation 18 cited 
Percentages From 10% to 98% <-- Average 612. 
d) On a continuing basis 61 
e) Upon initial employment 52 


f) Whenever an employee is introduced to a new function or process 


g) At regularly scheduled periods 47 _ 





h) During non-working hours _ 


1) During working hours_ 





Any additional remarks, either pro or con, which you feel would con- 
tribute to the research project. 
Outstanding examples cited in Chapter III. 


S6 





a» a 
' 
0 
—— _ = * * 
: - . -— 
a a = 
=> = ae ae 
__ 
= 
- ll 
_ a ae 
o 
a o 
>_> -_ 
= a, 
=i = 













—s 
ns | 


= —<_«- 


— — Gee 

Sas 
we _ 
—__ — 


el te | ed Por Yan 
Tere t Gees St 4+ femmes 
| eat <= ee & “yrs -—_ a”! me ¢ mit” 






















APPENDIX E 


Teaching Machines Cited As Being Used: ! 


Trade Name 


1, 


2% 


2) 


10. 


Videosonic 


Autc Tutor 


Mark II 


Minimax 


Model II 


Univox 


Edex 


Nortronics 


National 
Foremen 


KOG-7 


ACS Portable 


DIDAK 501 


Manufacturer 


Hughes Aircraft Co. 


USI Western 
Design 


Teaching Mtrs 
Corporation 
(Grolier) 


Universal 
Electronics 
Lab oratiotias 
GOED. 


Edex 


Nortronics Div. 
of Northrop Corp. 


Nat'l Foremen's 
Institute(div of 
Prentice-Hall ,Inc) 


Koncept-0-Graph 
Corp. 


Applied Commnuni-~ 
cations Sys. (Div. 
of Litton Sys. Inc.) 


Rheen Calivone 
Zorvs 


C2 
~Ji 


Nx, of concerns 


using 


Type 


Projected 8 
Media: Key 
Response 


Projected 13 
Media: Key 
Response 


Printed 16 
Media: 

Written 

Response 


Printed it 
Media: 

Written 

Response 


Classroom Z 
Cormunication 
Sys.(4& choice 
resps & Auto- 
mated Paper Rl) 


Audio-Visual 3 
Type Machine 
without Re= 

sponse Mech'nm 


Printed Media: 13 
Written Resp- 
onse 


Printed Media: 6 
Written Re- 
sponse 


Audio-Visual 1 
Type machine 
without 
Response 
Mechanism 


Printed Media: l 
Written Re- 
sponse 





eh. 


ee 


13% 


14. 


Se 


llfeye 


IEEE 


ie. 


1S ie 


20. 


from: 
Machines and Programmed Learning. (Washington, D.C. : 


DIDAK 601 
Besselere- 
Salesmate 


Key Punch Trainee 


AUEO MiItor Mari 1 


Audio Graphic 


Instructor 


Autoguide 


Mast 143 


Tachden 


Mentor 


Name Not 
Given 


Rheem Califone 
Corp. 


Rheem Electronics 


USI Western 
Design 


Graflec, Inc. 


Radio Corp. 
of America 


Mast Dev. Co. 


Aeronutronic 
(Div. of Ford 
Motor Co.) 


Thompson Ramo 
Wooldridge 


Printed Media: 
Key response 


? 


Computer Cone 
trolled psycho- 
motor Device 


Fro jected Media: 
Key Response 


Audio-Visual 
Type W/O Re= 
sponse Meche 
anism 


Audio-Visual 
Type W/O Re=- 
sponse Meche 
anism 


Linear Device 
using Filmstrip 
& Sound w/Option- 
al Branching 


Digital Come 


puter Program 


Printed Media: 
Key Response 


Total concerns Using Teaching Machines 


INO 


8B 


Preaaeron regarding Trade Name; Manufacturer, and Type taken 


U. S. Department of Health, Education and Welfare. 


Office of 


Education, Health and Welfare, 1962. p. 35-49 and 72-80. 


&9 


Teaching 








Or 


al. 


2. 


ES 


14. 


De 


Ilex 


a? 


few 


eye 


20% 


2s 


ZZ. 


2% 


APPENDIX F 
PUBLISHERS OF TEXTBOOKS AND SCRAMBLED TEXTBOOKS CITED IN 


QUESTIONNAIRE RETURNS 2 ?2 


Basic Systems Inc. 

Center For Programmed Instruction 
Doubleday & Company, Inc. 
Encyclopaedia Britannica Films 
General Atronics Corporation 
Generai Education, Inc. 

General Programmed Teaching, Corp. 
Hamilton Research Associates 
Harcourt, Brace & World, Inc. 
Hoit Rinehart & Winston, Inc. 
Institute of International Research 
International Teaching Systems 
Learning, Inc. 

The MacMillan Company 

Management Research Associates 
McGraw Hill Book Company 

New York Institute of Technology 
Radio Corporation of America 
Seminar, Inc. 

Sigma Press 

Science Research Associates 
Teaching Machines Inc. 


TOR Education, Inc. 
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24. Van Valkenburgh, Nooger & Neville 
25. William Barton Marsh Co., Inc. 


26. John Wiley & Sons, Inc. 


Bia eomneneton On Courses And Publishers is Available In: JU. S. 
Department of Health, Education and Welfare. Teaching Machines and 
Programmed Learning. Washington, D.C.: Office of Education, U. S. 
Department of Health, Education and Welfare, 1962. p. 52-80. 


2 ; ; 
Many firms did not cite publishers of textbooks uséd and others 
indicated their material was developed by consultants. 
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APPENDIX G 


Courses being taught with the aid of programmed instruction as cited in 
returned questionnaires: 


Number o£ 
concerns 
Course using 
1. Vectors 1 
2. Indoctrination! | by 
3. Preliminary Job Training? 17 
4. Retraining! 24 
5. English/Grammar 25 
6. Office proccaes 80 
7. Mechanical Proceocte: 6 
8. Management Training! 34 
9. Computer Programning 28 
10. Sales Training (Retail & Wholesale)! 62 
ll. Customer Ceethine 7 
12. Electricity 33 
13. Photography | 5 
14. Electronics! 58 
15. Supervisory Training 42 
16. Algebra 25 
17. Basic Mathematics 9 
18. Geometry 7 
19. Physics 6 
20. Trigononetry q 
21. Safety Practices! 5 
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42. 
43, 
44. 
45. 


46, 


Use of the Slide Rule 

Cost Control 

PERT/CPM 

Engineering Drawing 

Blueprint Reading 

Calculus 

Statistics 

Gyro Fundamentals/Servo Mechanisms 
iostegs Training 

Plant Protection 

Pitting 
Chemistry 

PRIME 

Tax Computation 

Psychology 

Inventory Control 

Product Knowledge! 

Numbers 

Navigation 

Logic 

Business Data Processing Problems 
Refining Processes 

Executive Practices Programs 
Fundamentals of Human Physiclogy 
Armament Systems (Air Foree)” 


TV Characteristics 
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48. Service Station Operation Training 


= 


49. Foreign Languages (Job Training) 3 


50. Foreign Languages (Off Duty Training) 


A 


Go 


51. Economic Analysis 
52. Inertial Guidance 2 


53. Human Motivation 1 


—_ 


54. SAGE Programming 


55. Boolean Algebra 5 


ee) 


56. Basic Computer Technology 


57. Fleet Balistics Missile Mechanics (U.S. Nee 1 
58. Sonar Operator Sounds (U.S. Navy)? L 
59. Radio Code (U. $. Navy)* 1 


f 
=| 
¢ 


wal 
ee 
NS 


Total Coursés Reported 


| 


Tpor the sake of brevity many programs have been included under 
a general heading. (e.g. Office Procedures includes filing, key 
punch operation, accounting, clerical machine operation, credit 
practices, switchboard operation, etc.; Sales Training includes 
such diverse industries as drug, insurance, rubber products, etc.). 


orca the United States Navy and United States Air Force have 
many more courses that employ programmed instruction but they have 
been included under general titles such as electronics, electricity, 
computer programming, inventory control, etc. 
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